Interactive augmented reality function

ABSTRACT

An apparatus is provided including a processor, a memory, and a vehicle tracking portal. The vehicle tracking portal is configured to obtain vehicle identification information regarding a vehicle. Then diagnostic information regarding the vehicle can be obtained. Then, based on the vehicle identification and the diagnostic information, a recommended service for the vehicle can be determined. A user can then be alerted to the recommended service.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of and claims the benefit of priorityunder to U.S. patent application Ser. No. 13/955,885, filed on Jul. 31,2013, which claims the benefit of priority under to U.S. ProvisionalPatent Application Ser. No. 61/682,973, filed Aug. 14, 2012, the benefitof priority of each of which is claimed hereby, and each of which areincorporated by reference herein in its entirety.

TECHNICAL FIELD

This application relates generally to vehicles. More particularly, thisapplication relates to a method and system of a vehicle tracking portal.

BACKGROUND

Most households own at least one vehicle, typically an automobile ortruck, but sometimes other vehicles as well, such as motorcycles, boats,all-terrain vehicles (ATVs), etc. It can be sometimes be difficult totrack actions related to these vehicles, such as vehicle diagnostics,service appointments, replacement parts, etc.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a network diagram depicting a client-server system, withinwhich one example embodiment may be deployed.

FIG. 2 is a block diagram illustrating a vehicle tracking portalapplication, which may be provided, in one example, as an application inthe networked system.

FIG. 3 is a screen capture illustrating a user interface presenting auser with a list of vehicles already linked to his or her account in thevehicle tracking portal application in accordance with an exampleembodiment.

FIG. 4 is a screen capture illustrating a user interface presenting auser with an area to enter vehicle identification information inaccordance with an example embodiment.

FIG. 5 is a screen capture illustrating a user interface presenting ascan screen in accordance with an example embodiment.

FIG. 6 is a screen capture illustrating a user interface presentingparts for a vehicle in accordance with an example embodiment.

FIG. 7 is a screen capture illustrating a user interface presentingdiagnostic information about a vehicle in accordance with an exampleembodiment.

FIG. 8 is a screen capture illustrating a user interface presenting analert that the user should schedule service in accordance with anexample embodiment.

FIG. 9 is a screen capture illustrating a user interface presentingservice centers to service a vehicle in accordance with an exampleembodiment.

FIG. 10 is a screen capture illustrating a user interface presenting anaugmented reality guide.

FIG. 11 is a flow diagram illustrating a method, in accordance with anexample embodiment, of providing a vehicle tracking portal.

FIG. 12 is a block diagram illustrating components of a machine,according to some example embodiments, able to read instructions from amachine-readable medium (e.g., a machine-readable storage medium) andperform any one or more of the methodologies discussed herein.

DETAILED DESCRIPTION

The description that follows includes illustrative systems, methods,techniques, instruction sequences, and computing machine programproducts that embody illustrative embodiments. In the followingdescription, for purposes of explanation, numerous specific details areset forth in order to provide an understanding of various embodiments ofthe inventive subject matter. It will be evident, however, to thoseskilled in the art, that embodiments of the inventive subject matter maybe practiced without these specific details. In general, well-knowninstruction instances, protocols, structures, and techniques have notbeen shown in detail.

In an example embodiment, vehicle-related applications are able toprovide various functions, such as monitoring vehicle diagnostics,scheduling service appointments, pre-pay for vehicle service usingonline or mobile payment services, locating desired items at a localstore, providing driving directions, and the like. Information can bedisplayed on either an in-vehicle display system such as a head unit, oron a user's mobile device.

In a further example embodiment, the head unit or other component of avehicle can be tied electronically with a user's mobile device. Thisconnection may be either via a wired connection, such as a USBconnection, or via a wireless connection, such as Bluetooth or IEEE802.11. The mobile device may further have connectivity to the generalInternet via a wireless connection, such as cell phone network such asCode Division Multiple Access (CDMA), Global System for MobileCommunication (GSM), 3G, 4G, or other wireless mechanism such as IEEE802.11 or WiMax.

In an example embodiment, the vehicle may leverage the two facts that(1) the head unit or component in the vehicle that is communicating withthe mobile device is built-into the vehicle; and (2) that the mobiledevice has connectivity to outside data sources. This allows the systemto provide applications that are tied to the precise vehicle, yet stillare able to access outside data sources such as the Internet.

In another example embodiment, this leverage may be used to providevarious levels of vehicle service. This includes the ability to provideservice reminders to the user (using car diagnostic data, for example),schedule service appointments for the vehicle (using the aforementionedcar diagnostic data and a user's mobile calendar application, forexample), offer service coupons (using vehicle location, for example),purchase vehicle parts online (using the car diagnostic data and anonline payment service, for example), provide directions to a localstore having vehicle parts in stock (using the car diagnostic data andGlobal Positioning System (GPS) information, for example), and providehow-to-instructions (for example, how to change a tire).

FIG. 1 is a network diagram depicting a client-server system 100, withinwhich one example embodiment may be deployed. A networked system 102, inthe example form of a network-based marketplace or publication system,provides server-side functionality, via a network 104 (e.g., theInternet or a wide area network (WAN)) to one or more clients. FIG. 1illustrates, for example, a web client 106 (e.g., a browser, such as theInternet Explorer browser developed by Microsoft Corporation of Redmond,Washington State) executing on a personal computer 108 as well as adedicated application 110 operating on a portable device such as asmartphone 112.

An API server 114 and a web server 116 are coupled to, and provideprogrammatic and web interfaces respectively to, one or more applicationservers 118. The application servers 118 may host one or moreapplications 120 related to vehicle tracking. The application servers118 are, in turn, shown to be coupled to one or more database servers122 that facilitate access to one or more databases 124.

The applications 120 may provide a number of marketplace functions andservices to users who access the networked system 102. This may includesales of goods and/or services, payment processing, etc. Also includedin these applications 120 may be a vehicle tracking portal, which mayprovide a centralized source for users to track various aspects ofvehicles they own (or vehicles they may wish to own at some point).

Further, while the system shown in FIG. 1 employs a client-serverarchitecture, the embodiments are, of course not limited to such anarchitecture, and could equally well find application in a distributed,or peer-to-peer, architecture system, for example. The variousapplications 120 could also be implemented as standalone softwareprograms, which do not necessarily have networking capabilities.

The web client 106 accesses the various applications 120 via the webinterface supported by the web server 116. Similarly, the dedicatedapplication 110 accesses the various services and functions provided bythe applications 120 via the programmatic interface provided by the APIserver 114. It should be noted that these embodiments are merelyexamples. It is, of course, possible that a dedicated application mayoperate on the personal computer 108, and that a web browser may operateon the mobile device 112.

The dedicated application 110 may, for example, be a client of a vehicletracking portal (e.g., the eBay Motors application developed by eBayInc., of San Jose, Calif.).

FIG. 1 also illustrates a third party application 126, executing on athird party server machine 128, as having programmatic access to thenetworked system 102 via the programmatic interface provided by the APIserver 114. For example, the third party application 126 may, utilizinginformation retrieved from the networked system 102, support one or morefeatures or functions on a website hosted by the third party. The thirdparty website may, for example, provide one or more promotional,marketplace, or payment functions that are supported by the relevantapplications of the networked system 102.

Also present in the client-server system 100 may be one or more vehicles130. The vehicle 130 may be owned by a user of the mobile device 112, ormay be a vehicle the user is interested in purchasing at some point. Aswill be described later, the mobile device 112 may interact in variousways with the vehicle 130 to retrieve and send information relevant tothe vehicle tracking portal. For example, a user may scan a vehicleidentification number (VIN) of the vehicle 130 or take a picture of thevehicle 130 with mobile device 112 to identify the vehicle 130 to theportal and set up the vehicle 130 in the portal. Additionally, themobile device 112 may interact with the vehicle 130 itself to obtaindiagnostic information (such as by scanning error codes from a computeron the vehicle 130, or interacting wirelessly with a device that tracksdiagnostic information in the vehicle 130).

FIG. 2 is a block diagram illustrating a vehicle tracking portalapplication 200, which may be provided, in one example, as application120 in the networked system 102. The vehicle tracking portal application200 may be hosted on dedicated or shared server machines (not shown)that are communicatively coupled to enable communications between servermachines. The vehicle tracking portal application 200 may becommunicatively coupled (e.g., via appropriate interfaces) to variousdata sources. The vehicle tracking portal application 200 mayfurthermore access one or more databases 124 via the database servers122.

The networked system 102 may provide a number of publishing, listing,and price-setting mechanisms whereby a seller may list (or publishinformation concerning) goods or services for sale, a buyer can expressinterest in or indicate a desire to purchase such goods or services, anda price can be set for a transaction pertaining to the goods orservices. To this end, the vehicle tracking portal application 200 isshown to include (or link to) at least one publication application 202and one or more auction applications 204, which support auction-formatlisting and price setting mechanisms (e.g., English, Dutch, Vickrey,Chinese, Double, Reverse auctions etc.). The various auctionapplications 204 may also provide a number of features in support ofsuch auction-format listings, such as a reserve price feature whereby aseller may specify a reserve price in connection with a listing and aproxy-bidding feature whereby a bidder may invoke automated proxybidding.

A number of fixed-price applications 206 support fixed-price listingformats (e.g., the traditional classified advertisement-type listing ora catalogue listing) and buyout-type listings. Specifically, buyout-typelistings (e.g., including the Buy-It-Now (BIN) technology developed byeBay Inc., of San Jose, Calif.) may be offered in conjunction withauction-format listings, and allow a buyer to purchase goods orservices, which are also being offered for sale via an auction, for afixed-price that is typically higher than the starting price of theauction.

Store applications 208 allow a seller to group listings within a“virtual” store, which may be branded and otherwise personalized by andfor the seller. Such a virtual store may also offer promotions,incentives, and features that are specific and personalized to arelevant seller.

Reputation applications 210 allow users who transact, utilizing thenetworked system 102, to establish, build, and maintain reputations,which may be made available and published to potential trading partners.Consider that where, for example, the networked system 102 supportsperson-to-person trading, users may otherwise have no history or otherreference information whereby the trustworthiness and credibility ofpotential trading partners may be assessed. The reputation applications210 allow a user (for example, through feedback provided by othertransaction partners) to establish a reputation within the networkedsystem 102 over time. Other potential trading partners may thenreference such a reputation for the purposes of assessing credibilityand trustworthiness.

Personalization applications 212 allow users of the networked system 102to personalize various aspects of their interactions with the networkedsystem 102. For example a user may, utilizing an appropriatepersonalization application 212, create a personalized reference page atwhich information regarding transactions to which the user is (or hasbeen) a party may be viewed. Further, a personalization application 212may enable a user to personalize listings and other aspects of theirinteractions with the networked system 102 and other parties.

The networked system 102 may support a number of marketplaces that arecustomized, for example, for specific geographic regions. A version ofthe networked system 102 may be customized for the United Kingdom,whereas another version of the networked system 102 may be customizedfor the United States. Each of these versions may operate as anindependent marketplace or may be customized (or internationalized)presentations of a common underlying marketplace. The networked system102 may accordingly include a number of internationalizationapplications 214 that customize information (and/or the presentation ofinformation) by the networked system 102 according to predeterminedcriteria (e.g., geographic, demographic or marketplace criteria). Forexample, the internationalization applications 214 may be used tosupport the customization of information for a number of regionalwebsites that are operated by the networked system 102 and that areaccessible via respective web servers 116.

Navigation of the networked system 102 may be facilitated by one or morenavigation applications 216. For example, a search application (as anexample of a navigation application 216) may enable key word searches oflistings published via the networked system 102. A browse applicationmay allow users to browse various category, catalogue, or inventory datastructures according to which listings may be classified within thenetworked system 102. Various other navigation applications 216 may beprovided to supplement the search and browsing applications.

In order to make listings available via the networked system 102 asvisually informing and attractive as possible, the applications 120 mayinclude one or more imaging applications 218, which users may utilize toupload images for inclusion within listings. An imaging application 218also operates to incorporate images within viewed listings. The imagingapplications 218 may also support one or more promotional features, suchas image galleries that are presented to potential buyers. For example,sellers may pay an additional fee to have an image included within agallery of images for promoted items.

Listing creation applications 220 allow sellers to conveniently authorlistings pertaining to goods or services that they wish to transact viathe networked system 102, and listing management applications 222 allowsellers to manage such listings. Specifically, where a particular sellerhas authored and/or published a large number of listings, the managementof such listings may present a challenge. The listing managementapplications 222 provide a number of features (e.g., auto-relisting,inventory level monitors, etc.) to assist the seller in managing suchlistings. One or more post-listing management applications 224 alsoassist sellers with a number of activities that typically occurpost-listing. For example, upon completion of an auction facilitated byone or more auction applications 204, a seller may wish to leavefeedback regarding a particular buyer. To this end, a post-listingmanagement application 224 may provide an interface to one or morereputation applications 210, so as to allow the seller conveniently toprovide feedback regarding multiple buyers to the reputationapplications 210.

Dispute resolution applications 226 provide mechanisms whereby disputesarising between transacting parties may be resolved. For example, thedispute resolution applications 226 may provide guided procedureswhereby the parties are guided through a number of steps in an attemptto settle a dispute. In the event that the dispute cannot be settled viathe guided procedures, the dispute may be escalated to a third partymediator or arbitrator.

A number of fraud prevention applications 228 implement fraud detectionand prevention mechanisms to reduce the occurrence of fraud within thenetworked system 102.

Messaging applications 230 are responsible for the generation anddelivery of messages to users of the networked system 102 (such as, forexample, messages advising users regarding the status of listings at thenetworked system 102 (e.g., providing “outbid” notices to bidders duringan auction process or to provide promotional and merchandisinginformation to users). Respective messaging applications 230 may utilizeany one of a number of message delivery networks and platforms todeliver messages to users. For example, messaging applications 230 maydeliver electronic mail (e-mail), instant message (IM), Short MessageService (SMS), text, facsimile, or voice (e.g., Voice over IP (VoIP))messages via the wired (e.g., the Internet), plain old telephone service(POTS), or wireless (e.g., mobile, cellular, WiFi, WiMAX) networks.

Merchandising applications 232 support various merchandising functionsthat are made available to sellers to enable sellers to increase salesvia the networked system 102. The merchandising applications 232 alsooperate the various merchandising features that may be invoked bysellers, and may monitor and track the success of merchandisingstrategies employed by sellers.

The networked system 102 itself, or one or more parties that transactvia the networked system 102, may operate loyalty programs that aresupported by one or more loyalty/promotions applications 234. Forexample, a buyer may earn loyalty or promotion points for eachtransaction established and/or concluded with a particular seller, andbe offered a reward for which accumulated loyalty points can beredeemed.

A portal module 236 may then act to implement various user interface andback-end functions to provide the actual portal to a user.

In an example embodiment, a user may utilize a mobile device 112 to linkone or more vehicles 130 with a vehicle tracking portal application 200.This may be accomplished in a variety of different ways. FIGS. 3-5 arescreen captures illustrating linking a vehicle 130 to a vehicle trackingportal application 200 using a VIN for the vehicle 130. Specifically, inFIG. 3, a user interface 300 may present a user with a list of vehicles302 already linked to his or her account in the vehicle tracking portalapplication 200, and a button 304 where the user can request to addanother vehicle 130. Pressing this button 304 may result in the userinterface 400 of FIG. 4, which includes tabs 402A, 402B to selectbetween “cars & trucks” and “motorcycles.” The user interface 400additionally includes an area 404 where the user can enter the VIN ofthe vehicle 130. The user may either enter the VIN manually (e.g., bytyping it in) or may press a scan button 406, which brings up a scanscreen. FIG. 5 is a screen capture illustrating a user interfacepresenting a scan screen in accordance with an example embodiment. Ascan be seen, the user interface 500 includes a viewing area 502depicting what is visible to a camera in the mobile device 112, and theuser can move the mobile device 112 in front of a VIN on the vehicle 130to scan the VIN.

Referring back to FIG. 4, the user can alternatively enter the year,make and model of the vehicle 130 using menus 408, 410, 412. This optionmay be useful to a user who does not know or doesn't wish to locate theVIN, or for users who do not actually own the vehicle 130 yet. To thatextent, the user can indicate using button 414 whether or not thevehicle 130 is owned by the user.

In another example embodiment, the mobile device 112 may retrievevehicle information via a wired or wireless link to the vehicle 130itself. Some vehicles 130 now offer a networking system where devicescan connect to the vehicle 130 for various applications. An example ofthis may be the SYNC® AppLink™ system offered by Ford Motor Company ofDearborn, Mich.

In an example embodiment, once the vehicle 130 has been listed in thevehicle tracking portal application 200, various functions may beprovided for the user based on the vehicle 130. FIG. 6 is a screencapture illustrating a user interface presenting parts for a vehicle 130in accordance with an example embodiment. Here, the user interface 600may identify the vehicle 602 as well as presenting a number of differentparts 604 for sale. These may be parts being sold via auction, fixedprice, or at third party sources. As more information is known about thevehicle 602, the different parts 604 presented may be dynamicallymodified. For example, if the vehicle 602 has 50,000 miles on it, thenthe parts 604 presented may be different than if the vehicle 602 has150,000 miles on it. Likewise, if the vehicle 602 has a four cylinderengine, then the parts 604 presented may be different than if thevehicle 602 has a V6 engine.

In an example embodiment, diagnostic information about a vehicle 602 maybe integrated into the vehicle tracking portal application 200.Diagnostic information is any information about an individual vehicle602. This may include specification information, such as engine type,fuel type, horsepower, tire information, etc., odometer information, aswell as performance information such as speed, miles per gallon, airconditioning functions. It may also include error or probleminformation, such as low tire, inefficient air conditioning, error codesgenerated in response to a check engine light, etc. FIG. 7 is a screencapture illustrating a user interface presenting diagnostic informationabout a vehicle in accordance with an example embodiment. The userinterface 700 may present diagnostic information in window 702,including odometer information 704, engine type 706, tire type andstatus 708, air conditioning maximum and status 710, and average MPG712.

As described above, the diagnostic information may be utilized topresent different parts available for sale that fit the vehicle.Additionally, this information may be utilized in order to recommendservice or parts to repair certain conditions detected with the vehicle.For example, the vehicle tracking portal application 200 may access adatabase 124 which informs it that this vehicle 602 is due for a tune-upevery 30,000 miles. The odometer information may be used to determinethat the vehicle 602 has been driven 29,985 miles. The vehicle trackingportal application 200 may then contact the user and inform them thatthey should schedule a tune-up. FIG. 8 is a screen capture illustratinga user interface presenting an alert that the user should scheduleservice in accordance with an example embodiment. Here, the userinterface 800 may present the alert 802 indicating the type of servicerecommended and the current odometer reading.

Additionally, the vehicle tracking portal could locate dealers ormechanics in the user's area that can perform the service, and informthe user of this as well. In an example embodiment, the user may bepresented with information indicating that a service appointment shouldbe scheduled, along with a recommended service location. The user maythen inform the vehicle tracking portal to go ahead and schedule theservice, and the vehicle tracking portal may contact the servicelocation and set up an appointment. FIG. 9 is a screen captureillustrating a user interface presenting service centers to service avehicle in accordance with an example embodiment. The user interface 900may present a list of service centers 902, along with dates and timesavailable for appointments 904, allowing the user to easily select adate, time, and service center to perform the service. The user mayselect only the service center, date, and time, and the system canautomatically schedule the appointment. Additionally, in some exampleembodiments, a coupon or coupons 906 for one or more of the servicecenters may be provided.

Additionally, the user may obtain turn-by-turn directions to the servicecenter directly from the vehicle tracking portal.

In another example embodiment, the vehicle tracking portal may be usedto pay for services to the vehicle. For example, the vehicle trackingportal may already contain financial information for the user, such asthe user's credit card information, which allows the user to purchase,for example, parts for the vehicle, through the vehicle tracking portal.This financial information may also be used to pay for the serviceappointment.

In another example embodiment, the user may wish to perform services,such as maintenance, himself or herself. In such a case, the vehicletracking portal can provide the user with how-to manuals specificallyfor the vehicle. Additionally, in an example embodiment, step-by-stepdirections can be provided in the form of an augmented reality guide. Anaugmented reality guide is a guide that overlays instructions orinformation about steps of a repair over an actual picture of a vehicle,such as a live picture taken with a camera of a mobile device of thevehicle's engine block.

FIG. 10 is a screen capture illustrating a user interface presenting anaugmented reality guide. Here, the user interface 1000 presents an image1002 taken in real-time from a camera on a mobile device. Overlaid onthe image 1002 are one or more objects, such as hand 1004, part 1006,and arrow 1010 indicating directions on how to locate and remove thepart 1006.

FIG. 11 is a flow diagram illustrating a method 1100, in accordance withan example embodiment, of providing a vehicle tracking portal. Atoperation 1102, vehicle identification information regarding a vehicleis obtained. At operation 1104, diagnostic information regarding thevehicle is obtained. At operation 1106, based on the vehicleidentification information and the diagnostic information, a recommendedservice for the vehicle is determined. At operation 1008, a user isalerted to the recommended service.

FIG. 12 is a block diagram illustrating components of a machine 1200,according to some example embodiments, able to read instructions from amachine-readable medium (e.g., a machine-readable storage medium) andperform any one or more of the methodologies discussed herein.Specifically, FIG. 12 shows a diagrammatic representation of the machine1200 in the example form of a computer system and within whichinstructions 1224 (e.g., software, a program, an application, an applet,an app, or other executable code) for causing the machine 1200 toperform any one or more of the methodologies discussed herein may beexecuted. In alternative embodiments, the machine 1200 operates as astandalone device or may be connected (e.g., networked) to othermachines 1200. In a networked deployment, the machine 1200 may operatein the capacity of a server machine or a client machine in aserver-client network environment, or as a peer machine in apeer-to-peer (or distributed) network environment. The machine 1200 maybe a server computer, a client computer, a personal computer (PC), atablet computer, a laptop computer 314, a netbook, a set-top box (STB),a personal digital assistant (PDA), a cellular telephone, a smartphone112, a web appliance, a network router, a network switch, a networkbridge, or any machine 1200 capable of executing the instructions 1224,sequentially or otherwise, that specify actions to be taken by thatmachine 1200. Further, while only a single machine 1200 is illustrated,the term “machine” shall also be taken to include a collection ofmachines 1200 that individually or jointly execute the instructions 1224to perform any one or more of the methodologies discussed herein.

The machine 1200 includes a processor 1202 (e.g., a central processingunit (CPU), a graphics processing unit (GPU), a digital signal processor(DSP), an application specific integrated circuit (ASIC), aradio-frequency integrated circuit (RFIC), or any suitable combinationthereof), a main memory 1204, and a static memory 1206, which areconfigured to communicate with each other via a bus 1208. The machine1200 may further include a graphics display 1210 (e.g., a plasma displaypanel (PDP), a light emitting diode (LED) display, a liquid crystaldisplay (LCD), a projector, or a cathode ray tube (CRT)). The machine1200 may also include an alpha-numeric input device 1212 (e.g., akeyboard), a cursor control device 1214 (e.g., a mouse, a touchpad, atrackball, a joystick, a motion sensor, or other pointing instrument), astorage unit 1216, a signal generation device 1218 (e.g., a speaker),and a network interface device 1220.

The storage unit 1216 includes a machine-readable medium 1222 on whichis stored the instructions 1224 embodying any one or more of themethodologies or functions described herein. The instructions 1224 mayalso reside, completely or at least partially, within the main memory1204, within the processor 1202 (e.g., within the processor 1202's cachememory), or both, during execution thereof by the machine 1200.Accordingly, the main memory 1204 and the processor 1202 may beconsidered as machine-readable media 1222. The instructions 1224 may betransmitted or received over a network 1226 via the network interfacedevice 1220.

As used herein, the term “memory” refers to a machine-readable medium1222 able to store data temporarily or permanently and may be taken toinclude, but not be limited to, random-access memory (RAM), read-onlymemory (ROM), buffer memory, flash memory, and cache memory. While themachine-readable medium 1222 is shown in an example embodiment to be asingle medium, the term “machine-readable medium” should be taken toinclude a single medium or multiple media (e.g., a centralized ordistributed database, or associated caches and servers) able to storeinstructions 1224. The term “machine-readable medium” shall also betaken to include any medium, or combination of multiple media, that iscapable of storing instructions 1224 for execution by a machine (e.g.,machine 1200), such that the instructions 1224, when executed by one ormore processors 1202 of the machine 1200 (e.g., processor 1202), causethe machine 1200 to perform any one or more of the methodologiesdescribed herein. Accordingly, a “machine-readable medium” refers to asingle storage apparatus or device, as well as “cloud-based” storagesystems or storage networks that include multiple storage apparatus ordevices. The term “machine-readable medium” shall accordingly be takento include, but not be limited to, one or more data repositories in theform of a solid-state memory, an optical medium, a magnetic medium, orany suitable combination thereof.

The instructions 1224 may further be transmitted or received over acommunications network 1226 using a transmission medium via the networkinterface device 1220 and utilizing any one of a number of well-knowntransfer protocols (e.g., HTTP). Examples of communication networksinclude a local area network (LAN), a wide area network (WAN), theInternet, mobile telephone networks, POTS networks, and wireless datanetworks (e.g., WiFi and WiMAX networks). The term “transmission medium”shall be taken to include any intangible medium that is capable ofstoring, encoding, or carrying instructions 1224 for execution by themachine 1200, and includes digital or analog communications signals orother intangible medium to facilitate communication of such software.

Throughout this specification, plural instances may implementcomponents, operations, or structures described as a single instance.Although individual operations of one or more methods are illustratedand described as separate operations, one or more of the individualoperations may be performed concurrently, and nothing requires that theoperations be performed in the order illustrated. Structures andfunctionality presented as separate components in example configurationsmay be implemented as a combined structure or component. Similarly,structures and functionality presented as a single component may beimplemented as separate components. These and other variations,modifications, additions, and improvements fall within the scope of thesubject matter herein.

Certain embodiments are described herein as including logic or a numberof components, modules, or mechanisms. Modules may constitute eithersoftware modules (e.g., code embodied on a machine-readable medium 1222or in a transmission signal) or hardware modules. A “hardware module” isa tangible unit capable of performing certain operations and may beconfigured or arranged in a certain physical manner. In various exampleembodiments, one or more computer systems (e.g., a standalone computersystem, a client computer system, or a server computer system) or one ormore hardware modules of a computer system (e.g., a processor 1202 or agroup of processors 1202) may be configured by software (e.g., anapplication or application portion) as a hardware module that operatesto perform certain operations as described herein.

In some embodiments, a hardware module may be implemented mechanically,electronically, or any suitable combination thereof. For example, ahardware module may include dedicated circuitry or logic that ispermanently configured to perform certain operations. For example, ahardware module may be a special-purpose processor 1202, such as a fieldprogrammable gate array (FPGA) or an ASIC. A hardware module may alsoinclude programmable logic or circuitry that is temporarily configuredby software to perform certain operations. For example, a hardwaremodule may include software encompassed within a general-purposeprocessor 1202 or other programmable processor 1202. It will beappreciated that the decision to implement a hardware modulemechanically, in dedicated and permanently configured circuitry, or intemporarily configured circuitry (e.g., configured by software) may bedriven by cost and time considerations.

Accordingly, the phrase “hardware module” should be understood toencompass a tangible entity, be that an entity that is physicallyconstructed, permanently configured (e.g., hardwired), or temporarilyconfigured (e.g., programmed) to operate in a certain manner or toperform certain operations described herein. As used herein,“hardware-implemented module” refers to a hardware module. Consideringembodiments in which hardware modules are temporarily configured (e.g.,programmed), each of the hardware modules need not be configured orinstantiated at any one instance in time. For example, where a hardwaremodule comprises a general-purpose processor 1202 configured by softwareto become a special-purpose processor 1202, the general-purposeprocessor 1202 may be configured as respectively differentspecial-purpose processors 1202 (e.g., comprising different hardwaremodules) at different times. Software may accordingly configure aprocessor 1202, for example, to constitute a particular hardware moduleat one instance of time and to constitute a different hardware module ata different instance of time.

Hardware modules can provide information to, and receive informationfrom, other hardware modules. Accordingly, the described hardwaremodules may be regarded as being communicatively coupled. Where multiplehardware modules exist contemporaneously, communications may be achievedthrough signal transmission (e.g., over appropriate circuits and buses)between or among two or more of the hardware modules. In embodiments inwhich multiple hardware modules are configured or instantiated atdifferent times, communications between such hardware modules may beachieved, for example, through the storage and retrieval of informationin memory structures to which the multiple hardware modules have access.For example, one hardware module may perform an operation and store theoutput of that operation in a memory device to which it iscommunicatively coupled. A further hardware module may then, at a latertime, access the memory device to retrieve and process the storedoutput. Hardware modules may also initiate communications with input oroutput devices, and can operate on a resource (e.g., a collection ofinformation).

The various operations of example methods described herein may beperformed, at least partially, by one or more processors 1202 that aretemporarily configured (e.g., by software) or permanently configured toperform the relevant operations. Whether temporarily or permanentlyconfigured, such processors 1202 may constitute processor-implementedmodules that operate to perform one or more operations or functionsdescribed herein. As used herein, “processor-implemented module” refersto a hardware module implemented using one or more processors 1202.

Similarly, the methods described herein may be at least partiallyprocessor-implemented, a processor 1202 being an example of hardware.For example, at least some of the operations of a method may beperformed by one or more processors 1202 or processor-implementedmodules. Moreover, the one or more processors 1202 may also operate tosupport performance of the relevant operations in a “cloud computing”environment or as a “software as a service” (SaaS). For example, atleast some of the operations may be performed by a group of computers(as examples of machines including processors), with these operationsbeing accessible via a network 1226 (e.g., the Internet) and via one ormore appropriate interfaces (e.g., an application program interface(API)).

The performance of certain of the operations may be distributed amongthe one or more processors 1202, not only residing within a singlemachine 1200, but deployed across a number of machines 1200. In someexample embodiments, the one or more processors 1202 orprocessor-implemented modules may be located in a single geographiclocation (e.g., within a home environment, an office environment, or aserver farm). In other example embodiments, the one or more processors1202 or processor-implemented modules may be distributed across a numberof geographic locations.

Although an overview of the inventive subject matter has been describedwith reference to specific example embodiments, various modificationsand changes may be made to these embodiments without departing from thebroader spirit and scope of embodiments of the present invention. Suchembodiments of the inventive subject matter may be referred to herein,individually or collectively, by the term “invention” merely forconvenience and without intending to voluntarily limit the scope of thisapplication to any single invention or inventive concept if more thanone is, in fact, disclosed.

The embodiments illustrated herein are described in sufficient detail toenable those skilled in the art to practice the teachings disclosed.Other embodiments may be used and derived therefrom, such thatstructural and logical substitutions and changes may be made withoutdeparting from the scope of this disclosure. The Detailed Description,therefore, is not to be taken in a limiting sense, and the scope ofvarious embodiments is defined only by the appended claims, along withthe full range of equivalents to which such claims are entitled.

As used herein, the term “or” may be construed in either an inclusive orexclusive sense. Moreover, plural instances may be provided forresources, operations, or structures described herein as a singleinstance. Additionally, boundaries between various resources,operations, modules, engines, and data stores are somewhat arbitrary,and particular operations are illustrated in a context of specificillustrative configurations. Other allocations of functionality areenvisioned and may fall within a scope of various embodiments of thepresent invention. In general, structures and functionality presented asseparate resources in the example configurations may be implemented as acombined structure or resource. Similarly, structures and functionalitypresented as a single resource may be implemented as separate resources.These and other variations, modifications, additions, and improvementsfall within a scope of embodiments of the present invention asrepresented by the appended claims. The specification and drawings are,accordingly, to be regarded in an illustrative rather than a restrictivesense.

The invention claimed is:
 1. An apparatus comprising: a processor unitexecuting a user interface module executable by a processor andconfigured to: retrieve step-by-step instructions as to how to perform aservice on a component; and present the step-by-step instructions to auser in the form of an interactive augmented reality function executableby a mobile device of the user, the augmented reality function, whenexecuted by the mobile device, utilizing real-time imagery gathered by acamera on the mobile device and displaying the real-time imagery on adisplay of the mobile device such that when the user aims the camera atthe component, parts of the component relevant to the service arehighlighted as an overlay on the real-time imagery on the display alongwith additional information on how the parts of the component should beacted upon by the user.
 2. The apparatus of claim 1, wherein theapparatus is the mobile device.
 3. The apparatus of claim 1, wherein theuser interface is part of a tracking portal.
 4. The apparatus of claim1, wherein the overlay includes an image of a hand identifying a part ofthe component that should be manipulated by the user.
 5. The apparatusof claim 4, wherein the overlay image includes an arrow indicating adirection in which to manipulate the part.
 6. The apparatus of claim 1,wherein the step-by-step instructions are retrieved from an applicationserver containing an identification of the component and diagnosticinformation regarding the component.
 7. A method comprising: retrievingstep-by-step instructions as to how to perform a service on a component;and present the step-by-step instructions to a user in the form of aninteractive augmented reality function by a mobile device of the user tobe displayed on a display of the mobile device, the augmented realityfunction, when executed by the mobile device, utilizing real-timeimagery gathered by a camera on the mobile device and displaying thereal-time imagery on a display of the mobile device such that when theuser aims the camera at the component, parts of the component relevantto the service are highlighted as an overlay on the real-time imagery onthe display along with additional information on how the parts of thecomponent should be acted upon by the user.
 8. The method of claim 7,wherein the overlay includes an image of a hand identifying a part ofthe component that should be manipulated by the user.
 9. The apparatusof claim 8, wherein the overlay image includes an arrow indicating adirection in which to manipulate the part.
 10. The apparatus of claim 7,wherein the step-by-step instructions are retrieved from an applicationserver containing an identification of the component and diagnosticinformation regarding the component.
 11. The apparatus of claim 10,wherein the diagnostic information is obtained from the apparatus. 12.The apparatus of claim 11, wherein the diagnostic information includesspecification information about the component.
 13. The apparatus ofclaim 11, wherein the diagnostic information includes performanceinformation of the component.
 14. The apparatus of claim 11, wherein thediagnostic information includes problem information about the component.15. A non-transitory computer-readable storage medium comprisinginstructions that, when executed by at least one processor of a machine,cause the machine to perform operations comprising: retrievingstep-by-step instructions as to how to perform a service on a component;and present the step-by-step instructions to a user in the form of aninteractive augmented reality function executable by a mobile device ofthe user to be displayed on a display of the mobile device, theaugmented reality function, when executed by the mobile device,utilizing real-time imagery gathered by a camera on the mobile deviceand displaying the real-time imagery on a display of the mobile devicesuch that when the user aims the camera at the component, parts of thecomponent relevant to the service are highlighted as an overlay on thereal-time imagery on the display along with additional information onhow the parts of the component should be acted upon by the user.
 16. Thenon-transitory computer-readable storage medium of claim 15, wherein theoverlay includes an image of a hand identifying a part of the componentthat should be manipulated by the user.
 17. The non-transitorycomputer-readable storage medium of claim 16, wherein the overlay imageincludes an arrow indicating a direction in which to manipulate thepart.
 18. The non-transitory computer-readable storage medium of claim15, wherein the step-by-step instructions are retrieved from anapplication server containing an identification of the component anddiagnostic information regarding the component.
 19. The non-transitorycomputer-readable storage medium of claim 18, wherein the diagnosticinformation is obtained from the apparatus.
 20. The non-transitorycomputer-readable storage medium of claim 19, wherein the diagnosticinformation includes specification information about the component.